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^ ABSTRACT • • ' - • , 

^•^^ The, Primary Reading Ercgrem was initiated ir 117 

* classrooms in 40 North Carqli-na schools, -.tc impidve the -^readijig' 
achievement of the primaVy school studei^ts. 2he same ^umter of ' 
control classrooms were^a^o selected for ccapariscx. Features of the 
program included increased funditig fc'i instructional ^ materials ;* use 
of volunteers ^and teacher aides for snail group and indivi^dualized 
instruction; staff development; comprehensive testing and > 
interpretation of result.s; and availahility c*f readinc ccrsultants. 
Effects of>the program were assessed using pretests and p„ost tests. of 

* thfe Comprehensive lests of Basic ll?ill£ a-rd the Prescriptive ' Reafing 
^inventory; results of the first year of testing indicated pcs'itive • 
program effects. Evaluation oontijiued through the second jear^ as, 

'program and comparison classes completirg grades one and^two were 
continued in corresponding program .or ccmpariscr classes ir grades, 
two ^and three. Post testing in March cf. the seccnd year revealed that, 
the class€(^ partiqipating in. the prog.faie sccxe'd significartly higher 
on both tests over the 15-month period than their coiintexparts in ime 
comparison classes. Scores for first-g-rade students who were in t^hew 
puQqiam for f i^ve months wete ndt stat ist ically " cif f erent frcm tho'^se . 
of comparison group students. (Autlicr/GEC) ' ^ 
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OVERVIEW 

•In August 1976, results of the first-year interim evaluation^f the Primary 
ReadiQg Program were presented to the 'State Board of Education. This follow-up 
rjeport will present the results of the program' for five months of .instruction, 
for first graders 'for the 1976-77 school year and fifteen months o/ instruction 
♦ for sec(vid and third graders who were program participants in both the 1975-76* , 
and 197,6r77' school years. 

The pilot program began in September 1975, with' 2.75 mil Lion dollars / 
^appropriated by the^General Assembly for the improvement of reading achievement 
in the prtmary grades in North Carol.ina. During the first year, $750,000 were 
spent to implement the program and its evalu?ition in 40 schools with 117 classes 
throughout North Caroling. The sa/ne schools contained an additional 117 c^lasses 
that were used as ]pomparison classes in the evaluation. The rema^ining 'two nil.linn 
dollars fAi/ided the initial s«h(ja>s,and classes plu^ 288 classes in 64 new/schools 
for the. second year. This repp^t is limited to the results of the initia^i 40* 
schools and. 117 classes. * ' - ^ ' 




FUNDI fIG 



The Primary Reading Program funds were allocated for: 



INCREASING the'reso.urces available to teachers for supplies arfd materials. 
Supplies and materials were provided at a cost of $5.70 per student in 
excess of the regular state and local allotment for^upplids ahd materials. 
These materials were used to supplement ajready available resqUfces. 

* ' • / ♦ * • . ij • 

PROVIDING "a teacher ^issi^tant (aide) to follow up reading activities with 
srtiall groups or inrfiyi dual ^students. An aide was provided for each class- 
room and, along with the teacher^ received training ij^reading. 

PROVIDING staff development which emphasized effective practices in teactjing 
reading. Before the implementation of the program, teachers, aides, and'- 
principals were involved in a week of regional inservice training with all 
thje benefit classes in their region. Ongoing inservice training continued 
throughout the school year within the specific administi^Jive units. Under the 
staff development effo^rts, teachers used their judgmeni^in selecting , • 
appropriate approaches and methods for teaching reading to eacfi child.^ ^Most 
teachers ejected to use a variety of strategies for each childidependinj 
upon the student's level Qf develCTpment. - T * 



PROVIDING for comprehensive test.ing and assistance in the inte 
and use of test results. Monies were appropriated for diagno^ti 
and services,, evaluation, and materials". Individualized test 
made available to principals, teachers, and parents. 



rpretation 

c instruments 
results were 
) 



PROVIDING each child witK individual attention ^from adultlvolunteers. Prin- 
cipals implemented the volunteer component: of the reading program. The 
principals^ recruited, supervised training, and set operational procedures 
for the volunteers' work in the classroom. Volunteers received training 
from the feacher and aide as they worked in the classroom. - ^ 

* INCREASING the consulti/ig services for reading. Participating classrooms 
were visited periodically' by loc^l* school district reading specialists and. - 
r^gTonal educati,on center reading consultants. Following ^each visit, the 
consultants reviewed th^ program and made written recommendations to thfe 
principals, ♦ - ' ^ ' ' 

PARTICIPANTS ' ^ l 

Schools were selected from application forms submitted by superintendents 
and principals to the .Department of Public Instruction's Division of Reading. 
TKese applications contained information on certain general requirements* which 
were necess^ary for acceptance, into the program. After the commitment of,thei local 
agency was reviewed, thfe Division of ^ea^ding chose the schools to participate ip 
the program in a manner which divided the schpols as equally as possible among.the , 
State's eight diducation regions, ♦ ' \ ^ • 

INSTRUMENTATION ^ , ^ ^ ' ^ 

Effef^ts of the program were measured by administering two types of reading 
achievement tests to both t'he benefit and ^^mparison groups. The first instrument 
contained the reading sections of the nationally normed Comprehensive Tests of 
Basic Skills (CTBS), The levels appropriate for grades one, two, and three were 
selected, administered, and scored to obtain staprfard scale scores, percentiles, 
and' grade equivalent scores. The second test, the Prescriptive Re^^ding Inventory 
(PRI), included levels which were appropriate for second and thi^^d^^aders, ' The 
PRI is a national ly,develx)ped test which identifies and measures a large number 
of skills necessary for reading. Both tests indicate how well each cMl'd has • 
learned these basic skills. The three groups of students "took the following 
series of tests during the two-year evalpati^on ^period: • " ^ 

^ Grade 1 is the designation given to Students who began the program in the 
flr^t grade during 1916-77. These studejits were administered the CTBS, 
Level A as*a pretext in Septemb6r'l976 and CTBS, Level B as .the postlest ' 
in March*1977. Thus, there were^five months of instruction betweeti the 
pretest and the posttest. * • ^ * 

Grade 1-2 fs the designation giv^h to stud^ts who began the program in the 
first grade during T975-76 and. continued iVthe pr//gram in the second grade 
during 1976-77. 'These students were administered^the CTBS, Level A as a" 
pretest in October 1975; the CTBS,. Level B as an intermediate postteSt during* 
/4ay 1976; the PRI, Level Red as an intermediate test in Septembgj 1976; and^ 
the CTBS, Level C and the PRf^ Level 'ked as po^ttests in March 1977. 'Tor 
th,is group there were fifteen'.months .of instruction between the October" 1975 , 
pretest and the March 1977 posttest, ♦ ' - ^ . . -/ * f 

Grade 2-3 is the designation giv^ to students "who begart the program 'in' the 
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sicond grade during 1^75-76. These students were admwistered the CTBS, 
Level C and the PRK Lfevel Red as pretests .in October ,1975; the CTBS, Level C 
and the PRI, Level f?ed as intermediate posttests in May 1976; and the CTBS, 
Level 1 and the PRI,, Level Green as posttests Jn March 1977, -^For this group 
there were fifteen months of instructioa between the October T975 pVetest 
and the^^arch 1977 posttest. , 



EVALUATION DESIGff 

^ < - -1 

The mam purpose of the evaluation was to determine the effect of additional 
resources on readi;ig achievement in the primary grades. The design required 
pr7ncij)als to select two a^ove-average teachers for' grades one, two, and three ^ 
and to provide two clas^s^of students at each grade level who were closely 
matched on ethnic, socio-ejconomic, and abifity levels.- These classes* and their ■ 
teachers were then randomly assigned to "benefit" and "comparison" groups by the 
staff of the Division of Research. Te^cher^ remained' in their benefit or compari- 
son role during the two-y^ar period ,'"whi le benefit and cqmp«rt;ison classes. were 
advanced intact from Grade 1 and Grelde 2 to' corresponding benefit and comparison 
Grade 2 and Grade 3 classes. Only those students, having pretests and^ postte's.ts 
who remained in the prograip for the entire two-year period were included in'the 
main evaluation results. Separate analyses were performed for current first-grade 
s.tudents ^ho had been in the program for only five months. • 

Random assignments wei^e not implemented -for rune -cla.sses because of medical 
and administrative problems. Since the randomization between these benefit and ' 
comparison classes was not implemented, the/nine classes were deleted from the 
evaluation design before, the program began. 

Any resource that was typically avaflable to a school was available to the, 
teachers and students in the comparison classes, but they were denied the resourtfces 
of the Primary Reading Program. . 

Field operations of the evaluation were accomplished with the assistance of 
personnel from the local school unit. To control. *for possibfe bias in test erdmin- 
istration, thp reading coordinator -from the local school unit administered the 
CTBS for the .benefit and comparison classed. The PR! was a much Tobger test which 
was administered over several, days. Te accomplish thfs^phiise of the testing, 
teachers administered the PRI tests to their own daises und^r^'the direction of 
the 'loca.l reading coordinator. . , ' 

Pretesting .y/as done, after one month of school (September 30 - October 3, 1975, 
for the CTBS and Octobe'r 13-17, 1975, -for , the PRI). .Posttesting after the first . 
year was done approximately seven months later (Hay 4'-5 for 'the CTBS^and May 7-10 
for the PRI). ' Pretest-ing for the second year was done only with CTBS* administra- 
tions in. the newly formed first gr^de (September 20 ~ October 6, 1976) and PRI 
administrations in the second grade (Septeniber 6-'T7, 1976). Second-year post- 
testthg with £he CTBS was done in Graces 1, 2,^and 3 and with the PRI in Grades' 2* 
and 3 (February 28 - March 11). Results of the second^year pos^ests were* v 
ceived-from the scorer on April ]2-, 1^77. ' > ' 

' Since classes, rattjer than students, were the units randomly assigned to 
benefit and comparison groups, the class mean score was. used as "the unit of analysis 
for the total experiment, ^ec&use classes had been matched by the principals, 
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analyses were pejrfOrtned on the difference scoris between the benefit and comparison 
classes for the overall^ evaluation. Expanded scale scores were ^ed in the CTBS 
anarlysis while the average nuipber of correct answers was the.PRI score analyzed. 

EVALUATIOfh RESULTS • ^ ^' 

CTB^ Achievement • . * ^ ^ . 

Students in the two-year PVimary ^Reading Program scored significantly higher 
than comparable students ifl the comparison classes on the^CTBS. Primary- Reading 
Program students who wer^e in the benefit class during the first gPade and half 
df the second grade (Grade 1-2) scored 6,2% higher than the comparison classes. 
Similar students in benefit classes in the second grade and half of the third 
grade (Grade 2~3)-^era.g€d 6.4% h'igher than corresponding comparison classes. 
First-grade students who had participated in the" "benef it classes /or five monttjs 
at the tirae of posttesting had gains which exceeded the comparison group, but " 
these gains were not statistically significant. 

; t r ^ . * • 

- ^ ^ ^ • *TABLE 1. ' ^ 

AVERAGE CTBS $TAN0ARO SC^^LE SCORE? ON T6tAL 4^EApiNG V\CHIEVEMENT 
, . FOR Sifc&FIT AMD COMPARISON CLASSES 



Benefit * ^ . Comparison 



Grade 


Number ^ 
<. of 
Classes 


Months 
Between 
* tests 


Pretest 


1 


36 


. 5 


199.25 


1-2 ^ 


. 35 


15, 


193.47 


2-3 


32 


' 1^ 


268.20 , 



258.74 59.49 T99.81 ^•254. 84 55.03 



3ei'.17 n 1*2. 97 2U,^9'- 371 r1 5 106tl6 



. Note: Analysis of covardanoe results fdp thd^ CTBS Standard Scale 

. . ^ Sgcm^ \n the oombined Grade 1-2 anfi Grade 2-3 groves indicated * 
r . r Statistically significant differences at the 0. 008 level 

' favoring tke^ benefit classes. Difference scores for G;rad^ 1 ^ 
* ' , classes that. began the program during the secox^i year had a 
significance lev^l of 0^23. Thes^ fifst-gr'ada results were 
c * ' yic^t rStatvsticall^ significant* ' ^ ' 

PRI Achieve me n t ^ * • ^ . • 

' On the o\ierall evaluatijDn, class scores* for the PRI were reported as ^the 
average number of items correct.^ ThMs figure was caVculatled for each benefit., 
and^each comparison class^ Differences in the posttest class averages oi^ the 
benefit and comparison grpups^w^e dbtained. Since only^the CTBS. was, admi ni stered . 
as a pretest to Grade 1-2 student's, whjle in the first grade, the PRI' posttest 

. ' . ' , '4 



~$^cores we|e^ ajjjyzed for, both Grade 1-2 and Grade 2-3 using class differences on 
the CTBS pre.test scores as a covariate. The CTBS pretest differences' between 
benefit and -comparison classes were not significant, • • 

At ppsttesting, the differences, in PRI scores averaged 2.,8 items for Grade 1-? 
and 6.2 iteirts for Grade 2-3. These differences were statis^tically significant 
'and favored the students ^in the Primary Reading Program. 



, / * TABLE 2 " • ^ 

AVERAGE Dumber- OF items correct on prescriptive 



READING INVENTORY 





(r^ 

Number 
of 
" Classes 


, Be*nefit 
. PjDSttest 


Cojnparison 
PQStte§t 


Difference 


'Gradq 


35 


102.^03 


99.23 


2i^Q • 


Grade 2-'3' 


'32* 


112.86 


106.66 


6.2t) * 



/ 



N0T€:^ Analysis of covavianae results for the PRT* Total Sdore 
using CTBS pretest results as a covariate indicated 
statistically sijgnificant*differenoes* for the combined 
\' Grade 1-2 and Grade 2-^3 groups at the OrOOl level 
favoring the benefit classes, , 



SUMMARY , 



The"Primary Reading Program is presently completing a two-year pilot sturdy 
designed to' improve reading achievement ^h the primary grades of North Carolina 
schools. Results of the fiVst year's operation, reported to the State Board of 
Education in August 1976, showed that students in the Primary Reading Program 
classes exhibited significantly, higher achievemeht scores on the Comprehensive ^ 
Tests of Basic Skills (CTBS) and the Prescriptive Reading Inventory (PRI) .than, 
comparable students in the comparison cl^sseST^.-. 

Evaluation continued through the- sedohd year far the first .and second-grade^ 
students. who were promote'd to the second and third grades. Those students in 
benefit . and comparison classes were continued in the*corresp6nding .benefit or 
copiparison class of the succeeding grade. Postlesting in the first wee1< .of ' 
March 1977 wealed that the -Primary Reading Program classes scored significantly 
higher 'over the f ifteen-jnqnth period than their counterparts in ttie compai'ison. , 
Classens on both the CTBS and the PRI. ^Scores for first-grade students who were 
in the program for five months (1976-77) were not s'tatistlcally dif^erentt^from 
those of comparison group students. ^ ' i 
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TABLE 1 



AVERAGE. CTBS STANDARD SCALE SCQRES 0/^ TOTAL READING ACHIEVEMENT FORj^ENEFIT AI)ID COMPARISON' CLASSES " 











Benefit 






— 

Comparison 




Grade 


Number 

of 
Classes 


Months 
Bfetween 
Tests . 


^ --S^retest 


Posttrest 


NIE* ' 
Posttest 


Pretest 


Posttest 


NTE* . 
Posttest 


1 


^ 36 / 
* 


5 


199.25 


25^74 


249 " 


199.81 


;254.84 


249 


\ ' ,2-3 ^ 


35 

3? ^ 


15 ' 

' 15 


198.47 . 
268.20^ 


322/31 
381.17 • 


306 ■ 
' ^340 


206»65; 
" 264.99 


317?31 
311.15 


309, • 
334„- 


to 










* 









» ^}io TreaPnent Expeatation '(NTE) based on pretest national peraentile ranking at the beginning of the 
• program, » ' . ' ' * 
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TABLr 2 








AVERAGE GAINS IN CTBS STANDARD SCALE SCORES ON TOTT^L READING ACHIEVEMENT 
FOR BENEFIT .Aftp COMPARISON CLASSES . 














Grade 


Months Between Tests 


Benefit Gain 


Comparison Gain 


Di fference 


^ 1 




. , 59.49 


• ■ 55.03 ^ 
» * 


4.46 I 


1-2- 




123,84 


116.66 \ 


7,18 - - 


>2-3 


^15^ 


112;97 

» ^ 


106.16 


> 6.81 7 

^ 1 y-w. 
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TABLE 3 ^ ^ 

GAIN SCORES OF PRimRY READING PROGRAM STUDENTS CONTRASTED WitH 
GAIN SCORES OF SIMILAR STUDENTS IN THE- NATIONS NORM GROUP 







Benefit 






Comparison 








NTE* 






\_NTE* ' 




Grade 


Gain 


Gain 


Difference - 


Gain 


-Gain 


Dj f fererlce 


1 


59.49 


49.75 


9.74 * . 


55.03 


49.19 


5.^ 




123.84 ^ 


107.53 


16.31 . ^. . 


-116. 6? 


>08.35 


8.31 














2-3 


112*97 


'71.8 


41.17 


106.16 


69.01 


^37.15 

















*.Vj Treatment Expeata,tion (NTE) based on pretest national percentile ranking at tiie beginning of 
the program. » . * • • ' 
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TABLE 4 



AVERAGE GAIN IN CTBS GRADE EQUIVALENT StORES ON TOTAL REAIJING ACHIEVEMENT FOR BENEFIT AND COMPARISON CLASSES' 

WHEN TESTED AT pE SIXTH MONTH, OF THE 1976-77 SCHOOL YEAR 







7 




Benefit 




# 

Grade 


Number 
of / 
Classes 


* 

Grade Equivalent 
Mdnths Between Tests 


Pretest 


Posttest 


Gain 


1 


36 


5 


0.8 


> 1.7 


.9 


1-2, 


35 " 


15 *- '* 

• 


. . 0.7' 


[ 2.6 


1.9 


1 2-3 


32 




^ 1.8 : 


B.7 


1.9 



' Comparison 

■ : :T 

Pretest Posttfest ^ 

0.9 . , " 1 i 7 ^ 
1.0 

1.8 • 3.5 . 



Gain 
.8 
1..4 
1.7 



■J 



£RJC 



. 12' 
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. Copies of thfSi document are available from the Division of Research, 
Department ofC Public Instruction, Raleigh, North Carolina 2Y611.. You may 
request additional Information by wr'iting or by calling 919 - m^ZZm. 
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